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Abstract. In this paper, we give an introduction to the rationality of the equivari- 
ant Morse stratification, and state the author's results on zeta functions of prehomo- 
geneous vector spaces. 
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Introduction 

The aim of this paper is to state the author's results on the global theory of zeta 
functions associated with prehomogeneous vector spaces and give an introduction 
to equivariant Morse stratifications and their rationality. 

Let Z, Q, IR, Cbe the set of integers, rational numbers, real numbers, and complex 
numbers respectively. Let A; be a number field, and Ok its integer ring. Let A and 
be the sets of adeles and ideles of k respectively. We use the notation \x\ for 
the adelic absolute value of x G A. Also let \x\oo be the product of absolute values 
of X at all the infinite places. 

Let G be a connected reductive group, V a representation of G, and xv an 
indivisible non-trivial character of G all defined over k. In this paper, we are 
mainly interested in the case when G is a product of GL(n)'s. The triple (G, V, xv) 
is called a prehomogeneous vector space if the following two conditions are satisfied. 

(1) There exists a Zariski open orbit. 

(2) There exists a polynomial 7^ A G k[V] such that A(gx) = x'((/)A(a;) where 
x' is a rational character, proportional to xv- 
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A polynomial A which satisfies the property (2) is called a relative invariant 
polynomial. We define V^^ = {x ^ Vk \ A(x) ^ 0}, and call it the set of semi-stable 
points. For practical purposes, we assume that there exists a one dimensional 
split torus To contained in the center of G such that if a G To, it acts on V by 
multiplication by a and xv{(^) = ct'^ for some e > 0. 

Our purpose in this paper is to outline the author's program to compute Laurent 
expansions at poles of zeta functions for prehomogeneous vector spaces when the 
group is a product of GL(n)'s. 

The notion of prehomogeneous vector spaces and their zeta functions was in- 
troduced by Sato and Shintani in [17]. However, some special cases were studied 
earlier by many mathematicians, most notably Siegel [20] and Davenport [4]. Nei- 
ther Siegel nor Davenport used the zeta function explicitly to obtain the density 
theorems for equivalence classes of quadratic forms [20] and binary cubic forms [4] . 
Davenport's result was later used by Davenport and Heilbronn [5], [6] to prove the 
density theorem for cubic extensions of Q, which states 
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C(3)' 

where k runs through all the cubic fields and Ayt is the discriminant of k. 

D. J. Wright and the author proved in [23] that generic Gyt-orbits of several 
"parabolic type" prehomogeneous vector spaces correspond almost bijectively with 
number field extensions of certain degrees. Therefore, by studying the global and 
the local zeta functions for those cases, we can expect certain density theorems 
where number fields are counted possibly with some weights. 

Let L C V^^ be a Gyt-invariant subset, and $ a Schwartz-Bruhat function on Va- 
Let id he a character of Gk^jGk- Consider an integral of the following form 

(0.1) Zl{^,u,s)= f \xv{9)\'oj{g)y2^gx)dg, 

JGaJGi. 



where dg is a Haar measure on Ga- If (0.1) is well defined for L = V^^ and Re(s) 
sufficiently large, we say that (G, V, xv) is of complete type. Otherwise, we say that 
(G, y, Xv) is of incomplete type. If (G, V, xv) is a prehomogeneous vector space of 
complete type, the zeta function is, by definition, the integral Zv^33($, cu, s). 

Suppose that (G, V, xv) is a prehomogeneous vector spaceof complete type. Then 
the meromorphic continuation and the functional equation of the zeta function were 
proved by reducing the problem to the local theory at infinite places (see [17], [15]). 
Therefore, in most cases, the Tauberian theorem implies the existence of a limit of 
the form 

^ cx''{\ogx f , 

\P(y)\oo <^ 

where fXy is a number determined by the stabilizer of y, and c, a, b are constants. The 
improved version of the Tauberian theorem in [17] gives us the error term estimate 
also. However, the existence of a similar limit for Gyt-orbits is unknown for most 
cases and does not automatically follow from the the meromorphic continuation 
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and the functional equation of the zeta function, or the knowledge of the location 
and the orders of the poles. The process to handle Gyt-orbits of prehomogeneous 
vector spaces from the viewpoint of zeta function theory is called the "filtering 
process" and was formulated by Datskovsky and Wright [3]. This process has to be 
modified for the general case, because the zeta function can have higher order poles 
in general, and it is likely that the possible generalization of this process requires 
answers to the following two problems. 

Problem A Determine the Laurent expansions at all the poles of the zeta function. 

Problem B Compute the local zeta function explicitly for special test functions. 

If we use the filtering process, the only pole we can use is the rightmost pole. 
However, it is likely that all the poles have to be studied in order to say anything 
about the rightmost pole. The author's approach to Problem A is a generalization 
of Shintani's approach in [18], and is based on the framework of equivariant Morse 
theory. We give an introduction to invariant theory and related materials for the 
sake of number theorists in §1,2. 

If f(s) is a meromorphic function having the Laurent expansion ^ai{s — sq)* at 
s = So, we call a^'s generalized special values of / at s = sq- Roughly speaking, we 
want to express the coefficients of the Laurent expansions at the poles of the zeta 
function by the generalized special values of the zeta functions which correspond 
to "unstable strata" in equivariant Morse theory. 

Let G\ = {g €z Ga I Ix^l*/)! = !}• It is easy to prove (see [17]) that if (G, V, xv) 
is of complete type and the function ^^.^y^ ^(gx) is integrable on G\/Gk, all the 
poles of the zeta function are simple and the residues can be computed. However, 
this assumption hardly applies to any important cases. Even though Siegel [20] 
and Davenport [4] essentially computed the residue of the zeta function at the 
rightmost pole for their cases, Shintani's work on the space of binary cubic forms 
is the first non-trivial work where Problem A was answered from the viewpoint of 
zeta function theory. 

The primary difficulty of Problem A is based on the difficulty of handling di- 
vergent integrals. So far, our main analytic tool to handle this difficulty is the 
smoothed Eisenstein series and the iterated use of the Poisson summation formula. 
We discuss the smoothed Eisenstein series in §5 and describe our program in §7. 

Among the eight cases in [23], four types ((72,-04,-05,-^6) are of incomplete 
type. Also even if we start with a prehomogeneous vector space of complete type, 
we have to face prehomogeneous vector spaces of incomplete type in the induction 
step anyway. In that case, we have to use generalized special values of the "adjusted 
zeta functions" (see [26]). For this reason, understanding of prehomogeneous vector 
spaces of incomplete type is essential to the entire theory. Therefore, from the 
viewpoint of Problem A, we can not restrict ourselves to prehomogeneous vector 
spaces of complete type. 

There are not so many prehomogeneous vector spaces of incomplete type for 
which the Laurent expansions at the poles of the zeta function is known. The space 
of binary quadratic forms is an example of such a case. The difficulty of handling 
prehomogeneous vector spaces of incomplete type is that some semi-stable points 
have extra stabilizing elements. As is shown in [19], [25], [26] the zeta function 
itself does not satisfy a functional equation. Instead, it is natural to consider an 
adjusted version of the zeta function. We discuss this issue in §6. 
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In §8, we list some examples of prehomogeneous vector spaces for which Problem 
A was answered. 

This manuscript was prepared mainly during the academic year 1990-1991 when 
the author was staying at SFB 170 Gottingen. The author would like to thank SFB 
170 for supporting this project. 



§1 Review of invariant theory 

In this section, we review invariant theory and equivariant Morse theory. We do 
not restrict ourselves to prehomogeneous representations in this section. 

Let A; be a perfect field. Let G be a split connected reductive group and V a 
representation of G both defined over k. This G does not correspond to the group 
G in the introduction. Instead, it corresponds to G' = Ker(xy). Note that since G 
is connected and xv is indivisible, G' is connected. 

For any group G over A;, let X*(G)^ X^(G) be the groups of rational characters, 
rational one parameter subgroups (which we abbreviate to "IPS" from now on) of 
G respectively. We choose a maximal split torus T C G. We define t = X*(T) (/) 
E, t* = X*(T) (g) R. Let tQ = X^(T) (g) Q, tc = X^(T) C etc. Elements in 
tQ,tq) are called rational elements. We fix a Weyl group invariant inner product 
( , ) on t*. We assume that if z^z' G tq,, then {z^z') G Q. Let || || be the metric 
defined by this inner product. We choose a split Borel subgroup T C B and a 
Weyl chamber C t* so that the weights of the unipotent radical of B belong to 
i- by the conjugation b — )• tbt~^ . We can identify t, t* by this inner product, and 
therefore, we consider || ||,t- for t also. 

We recall the definition of stability over k. Let tt : V \ {0} — > F(V) be the 
natural projection map. Let be the ring of polynomials invariant under the 

action of G^.. Suppose that P G is a homogeneous polynomial. We define 

F{V)p = {Tr{x) \P{x)^0}. 

Definition (1.1) Let y G P(V")^. We define 

(1) y is semi-stable if there exists a homogeneous polynomial P G such that 
y G nV)p, 

(2) y is properly stable if there exists a homogeneous polynomial P G A;[y]*^* such 
that y G F{V)p, all the orbits in F(V)p are closed, and the stabilizer of y in G^ is 
finite, 

(3) y is unstable if it is not semi-stable. 

We use the notation P(y)|'^ (resp. P(y)^jj^^) for the set of semi-stable (resp. 

properly stable) points. These are Gal(A;/A;)-invariant opensets of F(V)i. However, 
we will consider the set F(Vy^^~^^ in number theoretic situations only when P(y)|'^ = 

We will recall three equivalent definitions of the equivariant Morse stratification 
for the rest of this section. The first definition is invariant theoretic and is closely 
related to the Hilbert-Mumford criterion of stability. We need this definition, 
because we are interested in the rationality question in number theoretic situations. 
This approach is due to Kempf and Ness. The second definition is combinatorial 
and was given by both Kirwan and Ness. We need this definition for practical 
determination of the equivariant Morse stratification. The third definition is Morse 
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theoretic and is based on the convexity property of the moment map. The moment 
map and the Morse theoretic approach was used by Kirwan to prove the smoothness 
and the perfectness of the stratification when k = C 

(1) The invariant theoretic definition. 

Let k be an algebraicaUy closed field. We are only interested in the plain stability, 
so our situation corresponds to the case S = {0} in [8]. Let X be a variety and 
/ : Gm X a morphism. We imbed Gm to the one dimensional affine space Aff"^ 
in the usual manner. We say that lima^o /(ct) = y if / extends to a morphism 
from Aff^ to X and /(O) = y. If A is a IPS of G, we define P(A) = {p e G \ 
lima^o X{a)pX(a)~^ exists }. The group P(A) is a parabolic subgroup of G. 

Let X \ {0}. We define \V^x\ (resp. |y, a;|{o}) to be the set of IPS's A such 
that lima^o \{a)x exists (resp. lima^o \{a)x = 0). Let A be a non-trivial IPS of G 
(not necessarily in I y, x I). We consider when A belongs to |y, a;|{o}. Let x = ^iLi^i 
be the eigen decomposition with respect to A, i.e. \(a)x = ^^-i a^'Xi^ Xi ^ for 
all i , and pi ^ pj if z ^ j ■ 

Definition (1.2) 

N 

(1) //(x, A) = minp^, 

1=1 

(2) "(^■•^) = W- 



If Ai, A2 are two non-trivial proportional IPS's, then iy(x^ Ai) = iy(x^ A2). 
The following theorem is Theorem (3.4) [8] ((1),(2) were proved by Mumford in 
Proposition 2.17 [12]). 

Tiieorem (1.3) 

(1) The function iy(x^\) has a maximum value (which we denote by B^) on the set 
\V^x\ if it is not empty. 

(2) The condition Gx3 is equivalent to the condition that \V^x\^Qj is non-empty. 
Suppose that \V^x\^Qj is non-empty, and let be the set of indivisible IPS \'s 

such that iy(\^x) = B^. 

(3) The set A^ is non-empty, and there exits a parabolic subgroup P^ of G such that 
P^ = P(A) for all A G A^. 

(4) The set A^ is a principal homogeneous space under the action of the unipotent 
radical of P^ . 

(5) Any maximal torus of P^ contains a unique element of A^. 

We followed [8] for the definition of /i(a;,A). However, this is — /i^(a;,A) in [12]. 
Roughly speaking, if x ^ V corresponds to a geometric object, elements of A^ are 
IPS's which give the fastest degeneration of x. Now we are ready to state the 
stratification defined by Ness [13]. 

Suppose that x ^ V \ {0}, and Tr(x) is unstable. This means that A^ is non- 
empty. There is a unique IPS A G t- such that A is conjugate to any element 
of Ax- Let A' G Aj;. Let jS^ G t- be the element which is proportional to A and 
||/3x|| = ^(^7 A'). This l3x is uniquely determined by x, and is a rational element. 



5 



For /3 G t- n tQ, we define 



(1.4) 



Sf} = {xev\{0}\(3, = (3}. 



Let So = TT 



-1 



(F(y)""). Apparently, 



^\{o}=n^^, 



where /3 runs through aU the elements of t_ fl tQ. It turns out that we only have to 
consider finitely many such /3's. We discuss this issue in the second definition. In 
[13], Ness used the notion of the lengths of vectors (see [9]) to formulate the strati- 
fication. The fact that the formulation in [9] is equivalent to the above formulation 
is explained in Lemma 3.1 [10]. 

Hilbert-Mumford criterion of stability says that a point is semi-stable or properly 
stable if and only if it is stable or properly stable with respect to the action of all 
the non-trivial IPS's. The above theorem implies that if a point is unstable, there 
is a canonical choice of a IPS which, in a way, gives the worst degeneration of x. 
Since we are interested in number theoretic applications, one natural question is if 
we can choose such a IPS which is split over the ground field. This question was 
answered affirmatively by Kempf [8]. 

The following theorem was proved by Kempf (Theorem (4.2) [8]). 

Theorem (1.5) Suppose that x G Vk, and \V^x\^Qj is non-empty over the closure 
k. Then all the elements in are split, is rationally conjugate to a standard 
parabolic subgroup, and is a principal homogeneous space under the action of 
the k -points of the unipotent radical of P^. 

The above theorem was proved without the assumption that the group is split. 
This theorem implies that if x ^ Vk and |y, a;|{o} is non-empty over the closure A;, 
X is conjugate to y ^ Vk by an element of Gk and Aj^ contains a split IPS of T. We 
discuss the inductive structure of Sfs and its rationality in the next definition. 

(2) The combinatorial definition 

Let k^G^V etc. be as before. We can diagonalize the action of T because k 
is a perfect field. Let (xq, • • • ^xn) be a coordinate system of V whose coordinate 
vectors are eigenvectors of T. Let 7^ G t* be the weight determined by the z-th 
coordinate. The following definition is due to Kirwan. 

Definition (1.6) A point jS ^ Iq is called a minimal combination of weights if jS is 
the closest point to the origin of the convex hull of a finite subset of {71, • • • ,7jv}. 

We denote the set of minimal combination of weights which lie in by 03. In 
this definition, 03 is the index set of the stratification. Since 03 is a finite set, this 
means that the stratification is a finite stratification. It turns out that 5*0 is the 
set of semi-stable points. We describe the stratum Sfs for /3 G 03 \ {0}. The reader 
should note that Sfs can be the empty set. 

We change the ordering of {71, • • • , 7jv} = {7J, • • • , 7^} so that 



{7[J)<---<{7'nJ)- 
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We assume that 

((tI,/?),--- Aj'n^I^)) = ("^1, • ■■ ,m;,m2, • ■■ ,m2, • • • /nip,- ■■ .nip) 

mo 

where mo > 0, mi < • • • < nip are coprime integers. Since /3 G 03, there exists some 
1 < s < p such that ^ = Let e'- be the coordinate vector which corresponds 

to 7'. Let Vb be the subspace spanned by 

{e[\(MJ) = —}- 
mo 

We define 

Zf} = {7r{x) \ xeZf}\ {0}}, Yf} = {7r(x,y) | x G \ {0}, y G W^}, 

= G G I Ad{g)^ = 

The group is Stab^ in [10]. 

Let pfj : Yfj ^ Zjj be the projection map. Let be the indivisible rational 
character of whose restriction to T is a positive multiple of /3. Let Vjj be the 
indivisible split IPS of which is a positive multiple to /3. We define G ji = {(/ G 
I ^fiig) = !}• Note that is connected. The group Gfs acts on Zf^ linearly. 
Let be the set of semi-stable points with respect to this action. Let Pf^ be the 
standard parabolic subgroup of G whose Levi component is and fixes the set 
Yfj. Let Ufs be the unipotent radical of Pf^. Since is split, all these groups are 
split groups over k. 

Let = (Z^^^). We define Sg^j. = 7r~"^(S'^|.) etc. The following inductive 
structure of the strata was proved by Kirwan and Ness [10], [13]. 

Proposition (1.7) S^-, = Gj, Xp^, F;|. 

The fact that this Sfs and Sfs in (1) coincide is proved in [10, pp. 150-156]. More 
precisely, suppose that x G 5"^^, and A G A^;. Choose g G Gj. so that g\g~^ is a 
IPS of Ty. proportional to fi. Then gx must belong to Y^^ . 

(3) The convexity property of the moment map 

We assume that k = C Let K be a maximal compact subgroup of G, and Tk a 
maximal torus of K . We assume that the action of Tk on F(V) is diagonalized. Let 
g,l,t, be the Lie algebras of G^K^Tk respectively. Let t_ be a Weyl chamber. We 
choose a K invariant Hermitian product ( , )y onV . This defines a homomorphism 
of Lie algebras I i— )• u(iV) (the N dimensional unitary Lie algebra). We consider 
the Fubini-Study metric on f{V) defined by this metric. Let u be its Kahler form. 
If a G it defines a vector field on P(y). 

Definition (1.8) A map /i : f{V) i— > I* is called a moment map if it satisfies the 
following two conditions 

(1) /i is K -equivariant with respect to the co-adjoint action of K on t* , 

(2) dii{x){C){a) = cu^(C, a^) for all x G F{V), ^ ^ T^'^iV), and a (E t. 

If a moment map exists and K is semi-simple, it is uniquely determined by the 
above conditions. 
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For IP(V^), one can construct a moment map in the following manner. Suppose 
that X eV \ {0}, 7r(x) = y G F(y), and a G u(N). We define a map p. : F(V) 
u(iV)* by 



^xax 



/^(y)(«) = - ^- 
Z7r\/ — L(x^ X) 

Let /i be the composition of ji and the natural map u(N)* i— )• t* . This /i is a moment 
map. 

Let fiT be the composition of /i, and the projection t* — )• t*. The third definition 
of the stratification is based on the following convexity property of the moment 
map (see [1], [7] or, [12] Appendix by Mumford). 

Theorem (1.9) Let X C F(V) be a connected G-invariant closed subvariety. Then 
IJ.t{X) n is a rational convex polytope. 

For y = Tr(x) G IP'(V^), we consider the closest point of fJ,{Gy) D t*L to the origin, 
which we call jS^ ■ Let /3 G tq, H . By the identification t = t* , we can consider /3 
as an element of tQ fl t_. We define Sfs = {x \ jS^ = /3}. Clearly, 

^\{o}=n^^. 

This definition coincides with previous definitions. Kirwan proved that this strati- 
fication is perfect with respect to Hg{ ) ® Q (the equivariant cohomology group) 
using this formulation. The isomorphism if^(F(y))(g)Q ^ H*{BG)(E)H*{F{V))(E)Q 
is proved in 5.8 [10] (also see [2]). Also 

H*a{Sf}) ® Q = i?P, (Y^ ® Q = i?M, (Zf ) ® Q = if*(5C^ ) ® H*^^ (Zf ) ® Q. 

Therefore, this gives an effective way of computing HQ(F(Vy^) (/) Q. The basic 
reason why the stratification is perfect is that by A^, acts non-trivially on Zf^ by 
scalar multiplications, and it induces a multiplication by an element of H*(B<C^ ) (/) 
Hq^{Z^I^) (x) Q whose first component is non-zero via the Gysin map (see Theorem 
5.4 [10] for the details). 

This is the Morse stratification with respect to the function However, 
critical points are not isolated, so one has to give the direction of the Morse fiow, 
which is given by for points in Y^^ . 

Now we consider the situation in the introduction. Let {G^V^xv) be a preho- 
mogeneous vector space over a number field k. Let G' = Ker(xy) as before. The 
group G' is connected as we mentioned at the beginning of this section. Let 

Vk\{Q] = ]\Spk 

be the equivariant Morse stratification with respect to the action of G' . 
Lemma (1.10) Gk = G'j^Tk. 

Proof. We only have to show that xv is indivisible as a character of T also. Since 
all the characters of G are rational, we assume that k is algebraically closed. Let 
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C be the connected center, and G = [G, G]. Then G = CG^ G is semi-simple and 
T = T n G is a maximal torus of G. Suppose that xv = T. Since T is 

connected, this implies that x is trivial on T also. Since T/T = C/C D G = G/G^ 
we can extend x to a character of G. Regular elements are dense in G, so xv = ■ 
Therefore, p = ±1. 

Q.E.D. 

Let = {g e G \ Adg{j3) = and M'^ = n G' etc. Kempf's theorem 
(1.5) and (1.7) imply the following proposition. 

Proposition (1.11) S^k = Gk Xp,, 

Proof. Let x G Sf)k- Then any A G Aj; is split. Therefore, we can choose g in the 
remark after (1.7) from Gk- So gx G F|® fl "14 = Y^^ . Therefore, Gk X Y^^ SjSk 
is surjective. Suppose that g'i,g'2 £ Gj^, ti,t2 G Tyt, yi,y2 G Y^^^ and gitiyi = 
(/2^2y2- Then yi7r(tiyi) = y27i"(^2y2)- By (1.8), there exists p G P'^^ such that 
yi = py2,7r(tiyi) = 7r{t2y2)- From the first equation, p G -P^,f assumption, 
g2piiyi = y2^2y2- Therefore, yi = t^^p~^t2y2- Let p = t^^^pti . This pis an element 
of and satisfies the condition yiti = y2^2P, yi = P~^y2- 

Q.E.D. 

Equivariant Morse theory in algebraic situation like in this section was estab- 
lished around 1983. However, Kempf's paper appeared in Annals in 1978. There- 
fore, he proved the rationality of the Morse stratification before equivariant Morse 
theory was established. 

Of course, if (G^V^xv) is a prehomogeneous vector space over an algebraically 
closed field, the equivariant Morse stratification is the decomposition into G-orbits. 
But how do we determine the orbit decompositions of prehomogeneous vector spaces 
systematically? It is easy to observe from the second definition of the stratification 
that it is possible to write a computer program to determine all the possible 03 3 /3's. 
Moreover, the knowledge of 03 enables us to determine the inductive structure of 
each stratum also. 

§2 Examples of Morse stratifications 

We consider equivariant Morse stratifications for the following examples 

(1) G = GL(1) X GL(2), V = Sym!^k\ 

(2) G = GL(2) X GL(1)2, V = Sjm^P ® P, 

(3) G = GL(3) X GL(2), V = Sjin^P ® P. 

The zeta function for the case (1) was studied by Shintani. The case (2) is an 
example of a reducible representation and was studied by F. Sato [14]. The case 
(3) is the F4 case (or the quartic case) in [23]. 

For later purposes, we fix some notations. Let 

(2.1) = {q = {qu - ■ ■ .qn) e R"" \ qi + ■ ■ ■ + qn = 0}. 

Let tA„_iC be the complexification of tA„_i- For 

? = (?!,••• ,?n),g' = (?1, • • • ,?n) e 
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we define (q,q')A„-i = ^tlill- For z = (zi, ■ ■ ■ , Zn) ^ ^A„-iC and a permutation 
r, we define tz = • • • This inner product is invariant under permu- 

tations. By this inner product, we identify tA„_i with its dual space. Let || 
be the metric defined by this inner product. 

(1) The case G = GL(1) X GL(2), V = Sym^P 

The group GL(2) acts on V naturally, and if a G GL(1), a acts by multiplication 
by a. Let T C G be the kernel of the homomorphism G — > GL(y). We consider the 
character Xvit,g) = (det gYt~^ for {t,g) G G. We can consider xv as a character 
of G/T^ and it is indivisible as a character of G. It is known that (G/T^ xv) is a 
prehomogeneous vector space. Let G' be the kernel of xv- Then G' is isomorphic 
to SL(2). Therefore, t, t* can be identified with t^^ . We choose an identification 
E ^ t* by the map q {-q,q)- We choose = {g G E | g > 0} as the Weyl 
chamber. The weighs of coordinates of V are —3, —1,1,3. Therefore, there are two 
possibilities for /3, i.e. fii = 1, =3. The stratum Sf)^ is the set of forms with one 
double factor. The stratum Sf)^ is the set of forms with one triple factor (see [18], 
[22] for the details). 

(2) The case G = GL(2) x GL(1)2, V = SjmP ® P 

The group GL(2) acts on each irreducible component of V naturally. Let g = 
((/i,ti,t2) and V = (^1,^2), where 

gi G GL(2), ti,t2 G GL(1), G Sym.^k\v2 G P. 

We define gv = {tigiVi^t2giV2). Let T C G be the kernel of the homomorphism 
G — > GL{V). Let Xv{g) = {det gi)°'t\^t2^ be a character of G. The character xv 
is trivial on T if and only if 2a — 2bi — 62 =0. Suppose that this condition is 
satisfied and (0,61,62) is relatively prime. Then xv is indivisible as a character 
of G. We consider xv as a character of G/T. The kernel of xv is isomorphic 
to SL(2) X GL(1) by {gi,a) {gi,a^\a~^^ ). We assume that 26i > 62. We 
identify t* with IR^ by the map q = (51,52) — ^ ((—<Zi, <Zi), 6252, —6152)- We define 
((?i, 52), (51,52)) = 251 ?i + i4?252- We choose {(51,52) G | 51 > 0} as the Weyl 
chamber. The weights of the coordinates look as the following picture. 

• • • 



We call these points 71,11, 71,12, 71,22, 72,1, 72,2 from the left to the right and from 
the top to the bottom. Consider the convex hulls of the following sets 

(1) Ci : {71,22,72,1}, 

(2) C2 : {71,12,72,2}, 

(3) C3 : {71,22,72,2}, 

(4) Ci : {71,11,71,22}, 
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(5) Cs : {71,22}, 

(6) Ce : {72,2}. 



Ci 



Co 



C4 



Ca 



Let l3i be the closet point to the origin from Ci for z = 1, • • • ,6. In this case, 
there are precisely 6 unstable strata Sfs^^--- ,Sf)^ (The vector (0,— 61) gives the 
empty set). 

(3) The case G = GL(3) x GL(2), V = Sym^k^ (g) 

Let V be the space of quadratic forms in three variables v = (t^i , , ^^3)- We 
identify V with k^ as follows 

Qx{v) = Xiivl + + Xi'iViV'i + X22vl + X2'iV2V'i + Xssuf 

^ X = (xii, a;i2, xi3, a;22, 3^23, a;33)- 
The group Gi = GL(3) acts on V in the following way 

for gi G Gi- 

We identify V with V (B V . Any element of V is of the form 



Q — iQxi 7 Qx2 )? 
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where 

xi = (a^i, 11, 3^1,12, 13, 3^1,22, 23, 2:1,33), 

X2 = (2:2,11, 2:2,12, 2:2, 13, 2:2,22, 2:2, 23, 2:2, 33)- 

We use X = (2:1,3:2) as the coordinate system of V. 

If g = {gi,g2) £ GL(3) x GL(2) and g'2 = we define 

g ■ Q = {aQ 

Let T be as before. Let Xvigi,g2) = (det (/i)'^(det (/2)^ for gi G GL(3),(/2 £ 
GL(2). The character xv is tirvial on T, and we consider as a character of 
G/T. The character xv is indivisible as a character of G. 

First, we fix a metric on t*. We identify t* with t^_^ ® t^^ . For q = (gi, 52), = 
(5^52) ^ t*, we define (q^q') = (<Zi,<Zi)a2 + (<Z2 , <Z2)-4i • This inner product is Weyl 
group invariant. 

We define 



t*_ = {q = (gil,gi2;gi3,g21,g22) e t* I gii < gi2 < gi3, ^21 < g22}- 

We use as the Weyl chamber. The weights of follows 



2:1,11 


(1 


7 


2 
3 


7 


2 . 

3 ' 


1 

2 


-1) 


2:2,11 


(t 


7 


2 
3 


7 


2 . 

3 ' 




2 ' 2 ^ 


2:1,12 


(1 


1 

' 3 


7 


2 
3 


. 1 

' 2 


7 


-1) 


2:2,12 


(1 


1 

' 3 


7 


2 
3 


J 


1 

2 


,1) 


2:1,13 


(1 


7 


2 
3 


1 

' 3 


. 1 

' 2 


7 


-1) 


2:2,13 


(1 


7 


2 
3 


1 

' 3 


J 


1 

2 


,1) 


2:1,22 


(- 


2 

3 ' 


4 
3 


7 


2 . 

3 ' 


1 

2 


-1) 


2:2,22 


(- 


2 

3 ' 


4 
3 


7 


2 . 

3 ' 




2 ' 2 / 


2:1,23 


(- 


2 

3 ' 


1 

3 


1 

' 3 


. 1 

' 2 


7 


-i) 


2:2,23 


(- 


2 

3 ' 


1 

3 


1 

' 3 


J 


1 

2 


,i) 


2:1,33 


(- 


2 

3 ' 




2 

3 ' 


4 . 

3 ' 


1 

2 


-1) 


2:2,33 


(- 


2 

3 ' 




2 

3 ' 


4 . 

3 ' 




2 ' 2 / 



With our metric, the weights of the coordinates look as the following picture. 




We proved in [23] that q G V^^ if and only if the zero set of Qi = Q2 = in P| 
consists of precisely four points. The unstable strata also have geometric meanings. 
Tables (2.2) (2.3) are the list of unstable strata in this case (see [26] for the details). 
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Table (2.2) 
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Convex hull 


Conies 


3/33 




^ — ' 

A 
/ i\ 
/ 1 \ 
/ 1 \ 

/ ^ \ 

/ ^ >A 

/ ^ ^"S. 

/ — 




cj 

1 multipli 


city 3 point 










The local ring = 





Table (2.3) 



/3 


/3 ^ 








1 

2 


^2,nj2 for ji,j2 = 1,2,3 




/32 


7 

6 


3^2,22, 3:2,23, 2:2,33 




/33 


17 

6 


2:2,33 




/34 


1 

6 


2:1,13, 2:1,23, 2:2,13, 2:2,23 


2:1,33, 2:2,33 


/35 


11 
12 


2:1,33, 2:2,23 


2:2,33 


/36 


1 

24 


2:1,33, 2:2,ji,j2 forii,i2 = 1,2,3 


2:2,13, 2:2,23, 2:2,33 


/37 


1 

4 


2:1,33, 2:2,13, 2:2,22 


2:2,23, 2:2,33 


/38 


1 

42 


2:1,22, 2:1,23, 2:1,33, 2:2,12, 2:2,13 


2:2,22, 2:2,23, 2:2,33 




1 

10 


2:1,23, 2:2,13, 2:2,22 


2:1,33, 2:2,23, 2:2,33 


/3io 


2 
3 


^^,nJ2 for « = 1,2, Ji,j2 =2,3 





15 



§3 An invariant measure on GL(n) 

Let A; be a number field for the rest of this paper. Let G = GL(n). We choose 
an invariant measure on G in this section. We denote the fields of rational, real, 
complex numbers by Q, IR, C respectively. We denote the ring of rational integers by 
Z. The set of positive real numbers is denoted by IR_|_. For any ring i?, is the set 
of invertible elements of R. Let A; be a number field. Let OJt, OJtoo , 9?tiR , OJtc , 271/ be 
the set of all the places, all the infinite, real, imaginary, finite places of k respectively. 
Let Aj (resp. Aj ) be the restricted product of k^^s (resp. k^^s) over v G 271/. Let 
A^oo (resp. A;^) be the product of A;j,'s (resp. A;^ 's) over u G 2Jtoo- Then A = Aj^o X Aj, 
— ^oo ^ -^z • If a; G A or A^ , we denote the finite (resp. infinite) part of x by 
Xf (resp. Xoo)- If y is a vector space over A;, we define Vk^^Voo^Vf similarly. Let 

(Va) (Vqo) (Vf) be the spaces of Schwartz-Bruhat functions. 

For a place k^j is the completion at v. If u G 271/, Oj, C k^j is, by definition, 
the integer ring of k^j. The absolute value of k^j is denoted by | For x G A^ , 
we denote the product of |a;|j,'s over all v G 271/ (resp. v G 2Jtoo) by \x\f (resp. 
|a;|oo)- For v G 271/, let tTj, be the prime element, and |7rj,|j, = ■ Note that if v is 
imaginary and is the usual absolute value, | X I — I X I • 

Let ri,r2 be the numbers of real and imaginary places respectively. Let h^R^e 
be the class number, regulator, and the number of units of k respectively. Let Ak 
be the discriminant of k. Let £yt = 2^^ (27rY^ hRe~^ . We choose a Haar measure dx 
on A so that J^^^ dx = 1. For any finite place v, we choose a Haar measure dx^j on 

Ajj, so that dxv = 1. We use the ordinary Lebesgue measure dx^ for v real, and 

dx^ A dx^ for v imaginary. Then dx = |Ayt|~2 J^^c/xj, (see [21, pp. 91]). 

1 

For A G let A be the idele whose component at v is Al*^'! if u G 2Jtoo and 1 
if u G 271/. Clearly, |A| = A. We identify IR_|_ with a subgroup of A^ by the map 
A ^ A. Let A^ = {x G A^ | \x\ = 1}. Then A^ ^ AVA;"" x E+, and AVA;"" is 
compact. We choose a Haar measure d^t^ on A"^ so that J^i^f^x d^t^ = 1. Using 
this measure, we choose a Haar measure d^t on A^ so that 

f{t)d''t= f f f{\f)d''\d''t\ 

Jo JAI 

where d^ \ = \~^d\. For any finite place v, we choose a Haar measure d^t^j on k^ 
so that J^x d^t^ = 1. Let d^tv{x) = \x\~^dx if v is real, and d^tv{x) = \x\~^ dx /\dx 

if V is imaginary. Then d^t = Y\_v d^tv (see [21, pp. 95]). We fix a character 
<>= O^' of A/A;. 

Let (k{-s) be the Dedekind zeta function. As in [21], we define 

Zk{s) = |A,|t (vr-*r(^))" ((2vr)-^r(3))'-^ Us). 

For a character io of A^/A;^, we define S(ijj) = 1 if is trivial, and S(ijj) = 
otherwise. 

Let K = riuGsrrt '^here K^j = 0{n) if v is real, and = U{n) if v is 
imaginary, and = GL(n,Oj,) if v is finite. Let T C G be the set of diagonal 
matrices, and N C G the set of lower triangular matrices whose diagonal entries 
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are 1. Then B = TN is a Borel subgroup of G. We use the notation 




n(n — 1) 



1, 

for elements t G T^^iiniu) G respectively. Let 

T+ = {t = an{t^,- • • I ti, • • • > 0}. 

The group Ga has the Iwasawa decomposition Ga = KT^N^. So any element 
g G Ga can be written as 

g = k{g)t{g)nn{u{g)), k{g) G K, t{g) G Ta, n„(M(fi')) G iVA- 

Let T' = T n SL(n), and = T_|_ fl Tj^. We consider t in §1 for T'. We can identify 
t with iAn-i- For s G t^, we define t*, in the usual manner. Let p be half 
the sum of weights of iV, with respect to the conjugation by elements of T. Let 
= G Ga I Idet^l = 1}. 
Let du = rii>j duij. This is an invariant measure on N^. We choose an invariant 
measure dk on K so that dk = 1. Let d^t = d^ti ■ ■ ■ d^t^ (t = a„(ti , • • • , 
Let c/6 = t-^Pd'^tdu {t'^P = n^<, We choose an invariant measure on G 



A 



hj dg = t ^^dkd^tdu. Let c„(A) = a„(A, • • • , A). Let dg^ be the invariant measure 
on G^ such that for any measurable function on f{g) on Ga, 



oo 

Ga Jo Jg° 



f(g)dg = n / /(c^A V)^/^ A(/^/^ 



where d^ X = A "^c/A. We define invariant measures on Gk^, K^, Bk^, Nk^,Tk^ 
similarly, and denote them by dg^j^dk^j^db^j^du^j^d^t^j respectively. Then du = 

lA^tl""^ n„ du,, and d^'t = C"'^ d^'U. 
Let 

(3.1) 53„ = -^^^ r-^. 

We define Q3i = 1 for convenience. The volume of GL(n)^/ GL(n)yt is 



§4 The zeta function 

Let {G^V^xv) be a prehomogeneous vector space. We define the zeta function 
in a general manner. 

Our main interest is a function of the form Zl{^,lo,s) in the introduction for 
irreducible representations, but in order to carry out the induction, we have to 
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consider a slightly more general objects. Let To,e be as in the introduction. For 
any split torus T = GL(l)'', we define T_|_ to be the subset of Ta which corresponds 
to IR!(_ by the above isomorphism. Let T| = G\ fl T_|_. 

Let be a character of G\/Gk- A principal quasi-character of G\/Gk is a 
function of the form |^((/)|* where ^ is a rational character of G and s G C. If x is a 
principal quasi-character of G\/Gk, we extend it to Ga so that it it trivial on To-|-. 
Let X = (xi? ■ ■ ■ 7 Xl) be principal quasi-characters. We define xio) = Yli Xi{g)- Let 
,5^{Vk^) be the space of Schwartz-Bruhat functions on Va- 

For later purposes, we introduce some notations. 

Definition (4.1) LeA L C Vk be a Gk-invariant subset. For $ G .5^(Va); we define 

We use the notation ©5^ ($,</) instead of ©5^^ ($,</) etc. 

Definition (4.2) For a Gk-invariant subset L C V^^ and a Schwartz-Bruhat func- 
tion $ G .5^(Va); we define 

(1) Zl($,cu,x,5) = / cu(5)x(5)|xi-(5)I*0l($,5)c?5, 

(2) Zl+($,cu,x,5) = / cu(5)x(5)|xi-(5)I^0l($,5)c?5- 

lxv(s)l>i 

z/ i/ie^e integtrals converges absolutely. 

For x G Va;, let be the connected component of 1 of the stabilizer of x. Let 
be the set of points x G Va; such that does not have a non-trivial rational 
character. We expect that the largest Gyt-invariant set L for which the integrals 
(1), (2) converges absolutely for Re(s) ^ is V^. 

In [16], F. Sato proved this convergence under the condition that if the stabilizer 
of X is connected for any x G V^^ and = V^^ . F. Sato's paper [16] is written 
in classical language and the proof in adelic language can be seen in [24]. The 
above condition applies to many prehomogeneous vector spaces. However, there 
are several very interesting prehomogeneous vector spaces which do not satisfy the 
above condition. For those cases, it is useful to use invariant theory as follows. 

If X*(G) is generated by one element, we do not have to consider x, and therefore 
we write Zi($,c<;,s) etc. 

We give an alternative definition of the zeta function when the group is of the 
form G/T where G is a product of GL(n)'s, and T is a split torus contained in the 
center of G. 

Definition (4.3) For a connected reductive group G, we define G\ = {(/ G Ga | 
\x{g)\ = lfor allxeX*(G)}. 

If G = GL(n), GL(n)^ = {</ G GL(n)A | |det(/| = 1}. Suppose that G = 
GL(ni ) X • • • X GL(nj). Let lo = (cui , • • • , cuj) be characters of /k^ . We define 
uj{gi,--- ,gf) = uji{detgi)---ujf{detgf). Let S#{uj) = S{uji) ■ ■ ■ S{ujf). Let c,{Xi) 
be as in §3for G R+. For A = (Ai,--- ,A/) G E^, let c(A) = (ci(Ai),--- ,c/(A/)). 
Any element of Ga is of the form c(X)g^ where g^ G G^. We choose a subgroup 
f+ C T| so that T+ ^ T|/f+. Let g^ = tg° where t G f , 5° G G^. Let G^ = f G^ 
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and Ga = IR+ X G\. We identify To-|- with IR_|_. We use the measure dg^ on 
which is a product of measures we defined in §3. Let d^t he a Haar measure on T, 
and dg^ = d^tdg^. Let ]j = (X,g^ ), where A G IR+. We define d]j = d^Xdg^ . If we 
choose c/^t suitably, cu, x, s) is equal to the following integral 



cu, X, s) has a similar expression also. In particular, if X*(G/T) is generated 
by one element, G\ = and T_|_ is trivial. Therefore, in this case, we use the 
measure on which we defined in §3. Also we do not have to consider x- We 
used this kind of formulation in [26]. 

We say that (G, xv) is of complete type if for any x, there exists a constant 
cr(x) such that Zv^33($, cu, x, s) converges absolutely and locally uniformly for all 
cu, $, and Re(s) > c(x)- Otherwise we say it is of incomplete type. If (G, xv) is 
of complete type, we write cu, x, -s) or simply cu, x, -s) for Zy33($, cu, x, ■s) 

etc. 

Let G' be as in §1, and T' = T G'. Let t = X^{T') (g) R etc. We choose a 
coordinate system x = (xi,--- ,a;jv) whose coordinate vectors are eigenvectors of 
T. Let 7i G t* be the weights of Xi. For x ^ Vk \ {0}, we define = {i \ Xi ^ 0} . 
Let Gx be the convex hull of the set {7^ | z G /x}- 

Definit ion (4.5) A point x G Vk \ {0} is called k -stable if for any g G Gk, Cgx 

contains a neighborhood of the origin. 

We denote the set of A;-stable points by V^. 

We proved in [26] that cu, x, ■s) is well defined for L = if Re(s) is 

sufficiently large, and cu, x, ■s) is an entire function. For the cases where F. 

Sato's criterion of convergence of the zeta function does not apply, the set seems 
to coincide with V^. Therefore, except for a few cases, we know the convergence of 
the zeta function. 

Let G = GL(ni) x • • • x GL(nj), and (G, V) be a prehomogeneous vector space. 
For g = (gi, • • • ,<//), we define = {^gi, • • • ,^gf)- Let tq the longest element of 
the Weyl group of G. Let V* be the dual space of V. The action f{x) — )• f{g~^x) 
for / G V* defines a representation of G on V* . The action x — )• ^g~^x is a 
representation of G on V and the weights of this representation and the weights of 
the representation V* are the same. Therefore, these representations are equivalent. 
So there exists a bilinear form [x,y]'y on V such that [gx,y]'y = [x,^gy]'y. We 
define [x,y]v = [x,rGy]V and g' = Tc/g~'^T^^. Then [gx,y]v = [x, (g')'^ y]v for 
all x^y ^ V and g'^ is an involution of G. 

We define a Fourier transform $ of $ G .5^(Va) by the formula 



The determinant of GL(y) defines a rational character of G which we call Ry- 
Let Ky be the principal quasi-character of G^/Gk which is |«:y(y"^)|~"^ for g^ G G\, 
and is trivial on Tq^. For a Gyt-invariant subset L C Va, we define 



(4.4) 




(4.6) 




(4.7) 




xeVk\L 



xeVk\L 
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for g = (X,g^). If L = V^^, we drop L, and simply write J($,(/). For $ G S^{Va) 
and A G IR+, we define $a(3;) = $(A^)- By the Poisson summation formula, 

(4.8) Zi($,cu,x,3) = Zi+($,cu,x,3) + Zi+($,cu-\«:-V-\iV-3) 

+ / / JLi^x,g')d''\dg\ 

Jo JGlJGk 

For later purposes, we define an operator My^^^ on ,5^{Vk^) for a character u on 
Gk^jGk- Consider the standard maximal compact subgroup K. We fix a Haar 
measure dk so that dk = 1. 

Definition (4.9) Let $,c<; be as above. We define 

Mv,u;^{x) = / uj{detk)^{kx)dk. 
Jk 

If id is trivial, this is the operator to average over K . 



§5 Tiie smootiied Eisenstein series 

Let G be a connected reductive group not necessarily split over a number field k. 
We fix a minimal parabolic subgroup P C G. Let T C G be a maximal split torus 
contained in P. Let p be half the sum of positive weights. Let d be the dimension 
of T^. Let t° be the Lie algebra of T^, and = C. Let Ep{g,z) be the 
Eisenstein series of G with respect to P where g G G^, and z G t^*. 

We fix a Weyl group invariant Hermitian product ( , )o on t^*. Let || ||o be the 
norm defined by this product. Let L{z) = (z^p)o^ and wq = L{p). We choose an 
entire function tp^z) on t^* which is rapidly decreasing on any vertical strip. 

Definition (5.1) We define a function S'{g,w,ip) on G^^/Gk x C by the following 
contour integral 

^ ^ ^ ^e(w)>L(q) ^ ' 

where we choose q so that Ep(g^z) converges absolutely for lie(z) = q. 

We call (#'((/, tjj) a smoothed Eisenstein series. If there is no confusion, we drop 
and write (ff{g,w) also. 

Let , G t"* be simple roots. We fix a small positive number -q. Let K 

be a special maximal compact subgroup of Ga, so Ga = KP^. The group K is 
contained in G\. Let = {t G | t"' > -q for all z}. We can choose a compact 
set O C Pa so that A'T°0 surjects to G^/Gk- We can also choose a compact set 
O C G^ so that {ktnt-^ \ k e K,t e T^,n G 0} C 0T°. 

Let = OiCti I cii,--- ,(id > 0}. If ri,r2 G t"*, then we use the notation 
ri > r2 if ri — r2 G ■ Let r G t"*. Let C{G\I Gk) be the set of continuous 
functions on G\IGk- We define 

(5.2) G(GVG,,r) = {/GG(Gl/G,)| sup \f{kty\<^}. 
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If / G C{G\I Gk^r) for some r, we say that / is slowly increasing. A function / is 
integrable on G^^/Gk if / £ C{G\I Gk^r) for some r > —2/9. 

Conjecture (5.3) 

(1) There exists a constant Co with the property: for any e > 0, there exists 
S > such that if M > wq, 



sup 

uiQ - S<Re(ui)<M 
g = kt, fcgn.tgT^ 



6 {g,w,'ip) 



W — Wq 



f < oo 



for some r G t* satisfying ||r||o < e. 

(2) There exist constants c\ > 0,C2 such that if Mi > M2 > wq^ 

sup \c^{g, w, ^'=1 < 00. 

M2<'Re(w)<Mi 
g = kt, fcgn.tgT^ 

The statement (1) of the above theorem implies that if / G C{G\I Gk^r) for 
some r > —2/9, then the integral 



f{g)S'{g,w,il))dg 

is well defined for Re(t/;) > wq^ can be continued meromorphically to Re(t/;) > wq — S 
for some (5 > 0, and the principal part around w = wq is 



w - Wo JgI/Gu 

The statement (2) of the above theorem implies that if / is a slowly increasing 
function, 

/ f{9)'^{9,w,tp)dg 
JgI/Gu 

is well defined and becomes a holomorphic function in some right half plane. 

If the statement of (5.3) is true for a group G, we call it Shintani's lemma for 
G, because we are generalizing Lemma 2.9 [18]. The author proved the following 
theorem in [26]. 

Theorem (5.4) The conjecture (5.3) is true if G is a product o/GL(n)'s. 

If G = GL(n), the constant Cg is 53""^. The proof of this theorem is fairly 
technical and involves estimates of Whittaker functions. We briefly explain why we 
have to use the linear function L{z) by the case of GL(n). We consider the Borel 
subgroup B. 

In this case, the Weyl group is the set of permutations of the set {!,••• , n}. For 
a permutation r, we deflne 

MAz)= n 



r(i)<T(j) 



Zk{Zr{t) - + 1) 
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The constant term of EB{g,z) is equal to Mr{z)t'^^~^^ ■ Let 



27r\A^ / / Re(z)=g — L(z) 

^ ' Re(ti>)>i(g) ^ ' 

where we use the same q as in (5.1). 

Note that if r is an element of the Weyl group, {—t~^p^—t~^p)q = (p,p)o. 



Therefore, —T~^p lies on the sphere of radius (/?, p)o . It is easy to see that 
—T~^p = p if and only if r is the longest element of the Weyl group. Therefore, 
L{—T~^p) < L{p) unless r is the longest element. If z = —T~^p, then — 
ZT(i) ^ 1 for all (z,j) such that i > i,T{i) < T(j). Therefore, we can choose q 
in a neighborhood of —T~^p so that — -ZT(j) > 1 for all such pairs. Then 

\^rig,'w,tp)\ ^ t'^'^'^P. The value ||Tg + p\\o can be arbitrarily small and L(q) < wq, 
if T is not the longest element. This consideration is enough for (1) when r is not 
the longest element. If r is the longest element, we consider the residue of Mr{z) 
along zi — Z2 = 1 then along Z2 — zs and we continue this process. Since the eventual 
residue is the constant function 53""^ as a function of g, we get (1). This argument 
for constant terms is fairly easy and is seen in Langlands' work [11]. However, in 
[26], we spent most of our labor to the estimates of the non-constant terms. The 
statement (2) is slightly trickier, and the reader should see [26] for the details of 
the proof of Theorem (5.4). 

§6 Adjusting terms 

In this section, we illustrate the necessity of adjusting terms by the example of 
the space of binary quadratic forms. Let G = GL(1) X GL(2), V = Sym k'^ . Let 
T C G be the kernel of the homomorphism G — > GL(y). Let Xvit^g) = t det g for 
(t^g) G G. Then xv is a rational character of G/T and is indivisible as a character 
of G. In this case, is the set of forms without rational factors. 

Let id be as in §3. We do not have to consider x in (4.1). We use the alternative 
definition (4.3) of the zeta function for L = i.e., 

(6.1) Zy($,cu,5)=/ X'io(g°)ev^4^^,Xg°)d''Xdg° etc. 



Definition (6.2) For u G A, we define 

{sup(1,|mj,|j,)~-^ forve'Oytf, 

(1 + |m„|^)~2 /oruGOJtiR, 

(1 + |m„|„)~^ for V G OJtc- 



Definition (6.3) Let v he a place of k. Let \E',\E'u he Schwartz-Bruhat functions 
on ^k1 respectively. Lets,si he complex variahles, and u a character ofA^/k^. 
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We define 

(2) Ty(^,cu,s,si) = / uj(t)\t\'a(uy^<i>(t,tu)d''tdu, 

J AX xA 

(3) Ty+(^,cu,s,si) = / u(t)\t\'a(uy'<i>(t,tu)d''tdu, 

/ AX X A 
|t|>l 

(4) Tl,{^>,Lo,si)= I Lo{t^)a{uy^^>{t^,t^u)d''t^du, 

Ty(^',cu,s,si). 



(5) Ty„(^'„,cu,s,si) = 



si=0 



Let i?y^o$ £ .5^(A^) be the restriction of $ to the set of elements of the form 

{Q,Xi,X2) 

Definition (6.4) 

If ^' = O^-^, then Ty(^',cu,s,si) = |A;t|-2C^i T„(^'„,cu, s, si). Suppose that 
^> V is the characteristic function of o^, and is triviaL Then easy computations 
(see (2.10) [25]) show that 

1 _ 

T„(M/„,CU,3,3i) = _ / + 

(1 - )(1 -q^' ') 

In general, Tj,(\E'j,, cu, s, si ) can be continued meromorphically everywhere, and 
is holomorphic for Re(s) + Re(si) > l,Re(s) > 0. Therefore, (\E', cu, s, si ) can be 
continued meromorphically everywhere, and is holomorphic for Re(s) + Re(si) > 
2,Re(s) > 1. Also the integrals defining Ty_|_(\E', cu, s, si ), Ty(\E', cu, si ) converge 
absolutely and locally uniformly for all We call Zy^ad($, ^, ■s) the adjusted 

zeta function for and '^^'^^^^ — ^Ty(i?y^o^y,u;$, , ■s) the adjusting term. 
■^y,ad($, ^, ■s) has finitely many poles and satisfies a functional equation 

Zy,ad($, ^, s) = Zy,ad($, ^"^ , 3 - s). 

We will state the principal part of Zy^ad($,^, -s) in §8. Also the author proved that 
generalized special values of Zy^ad($,^, -s) contribute to the poles of zeta functions 
in [26]. 

First we briefly explain how the adjusting term arises. Let Hy be the subgroup 
of G generated by T and the element (1,tgl(2))- 

Proposition (6.5) Let 



Xhv = {it,ka{ti,t2)n{u)) e Gl \ k e K,\tit-^ \ > Ja{t-^t2u)}. 
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Then for any measurable function f{g) on G\l H 



Vk, 



f{g)dg = / f(g)dg, 

if the right hand side converges absolutely. 

Let Z'l^ be the set of points of the form (0,a;i,0) such that xi ^ 0. Then 
GkZ'^Qj^ = Gk XHvk ^'o^k- reason why we need the adjusting term in this case 
is that we have to consider the fundamenental domain Xhv for the group Hy in 
order to handle the set V^^ \ V^. 

Suppose that (G^V^xv) is a prehomogeneous vector space of incomplete type. 
Then if L is the maximal subset such that (4.1) converges absolutely and locally 
uniformly for Re(s) ^ (assuming such L exists), the author expects that V^^ \ L 
decomposes into finite Gyt-invariant subsets Sst,i^ • • • , Sst,iv where Sst,i — Gk XHv ik 
Z'q'^-^, Hy^i C G is a (not necessarily connected) reductive subgroup of G^ Zq ■ C V 
is an ify^i -invariant subspace, and Z'^^ is the set of semi-stable points with respect 
to Hy^i n G' for all i. Let Hy^ be the connected component of Hy^i which contains 
the unit element. Suppose that for each z, there exist functions ay^n, ■ ■ ■ ^ay^ijy . 
and that if 

^Hv,i = {g^ e Gi I (^v,ziig^) > ir-- ,(^v,zjv,iig^) > i}, 

then i is invariant under the right action of Hy-f^, and 



fig')dg' = / fig')dg'. 

Suppose that these conditions are satisfied. 
Definition (6.6) Let Si = (s^^i,--- .,Si^jy.) G O^-' . We define 

(1) Ty,^($,CU,X,5,S^) 

= / A^cu(^/i)x(^/^)n««i(^/')'^'05.M(^'A^/')^/"At/^/^ 

Jw.+ xGl/Hv,ik J 

(2) Ty,^+($,CU,X,5,S^) 

= ( AM^/')x(^/')n«^^(^^')^^'0^-.(^'A^/'KAV, 

A>1 j 

(3) T^^,($,cu,x,3,) 

Kg')xig')l[c.^Jig'r&s.U<^,g')dg\ 



G\l Hv,ik 



(4) Ty,,($,cu,x,3) 



d 
dsi 



d 



si=o dsjy. 



ry,z($,tu,x,5,si, • • • ,Sjy ,) etc. 
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if these functions are well defined. 

We expect Ty,^+($,a;, x, s, s,), T^^^($,a;, x, s,) to be entire and Ty,^($,a;, x, 5, Sj) 
is well defined if Re(s) ^ depending on Si. 

In the case V = Sym^A;^, our adjusting term appeared in this way. Also we 
proved in [25] that Ty_|_(\I/, cu, s) is an entire function, and Ty(\I/, cu, s) is holomor- 
phic for Re(s) > 2. Therefore, cu, s) does not effect the right most pole. 

The author expects similar properties for the general adjusting terms (see [26] for 
example). 



§7 The general program 

In this section, we describe our program to compute the principal parts of zeta 
functions for prehomogeneous vector spaces when G is a product of GL(n)'s. 

Definition (7.1) Let fi{w),f2{w) he meromorphic functions on a domain of the 
form {w G C | Re(t/;) > A}. We use the notation fi ~ /2 if the following two 
conditions are satisfied. 

(1) There exists a constant A' < wq such that fi — f2 can be continued meromor- 
phically to the domain {w G C | Re(t/;) > A'}. 

(2) fi{w) — f2{w) is holomorphic around w = wq. 

Consider the identification G\/Gk = T X G\IGk in §4. Suppose that 



ir 



where hi{t) is an integrable function on T, kt^ G fiT^, and that r G t"* satisfies the 
condition r > —2/9. Let dg^ = d^idg^ . By (5.4), 

io{/)x{t)JL{^, tg'),^{g\w, ^P)dg'> 

TxGl/Gk 

^"""^^^^ ^ Lo{/)xii)JL{^.tg')dg' 



W - Wo .JTxGl/Gk 

Suppose that (6.6) is well defined. Then we can state our program as follows. 

Program (7.2) Find constants Cv,st,ir-- ,C'i^,st,zv, points pi(x)r-- iPdvix) ^ C 
and distributions a($, cu, x), ciij ($, cu, x) for i = 1, • • • , dy^j = 1, • ' ' ? (^v,i with the 
following properties 

(1) / Lo(/)x(t)JLi^,g')^ig\w,,l;)dg' 

■^Gl/Gk 

- ^^J2Cv,,,{Tl./^^u-^) - T^,($,c.)) + ^^a($,c.,x), 

W — Wq ^ — ' ' ' W — Wq 

1 = 1 

(2) a($A, cu, X) = Y.Y. ^""''^"^Hlog A)^a.,($, cu, x), 

1=1 j=i 

where A G 



25 



The following equations are easy to verify. 



^0 



Al; 



SO 



We define 

dv 

(7.3) ZL,ad($,tU,X,3) = ZL{<^,UJ,X,s) + J2Cst,^Tv,^{<^,^,X,s) 

i=l 

and call Zi^ad($, ^, X? ■5) the adjusted zeta function. 

Then if (7.2) is carried out, we get the following formula for Zi^ad($,^, X? -s) 

(7.4) Zi,ad($,CU,X,3) 

= Zl+($,cu,x,5) + ZL+{^,io-\KvX~\N - s) 

iy 

+ J] a,,,(Ty,,+ ($, cu, X, 3) + Ty,,+ ($, Kyx"' , iV - 3)) 

i=l 

dv '^V,i 



.=i,=i '(^-p«(x))^'+^' 

We expect that the first four terms to be entire and that the adjusting terms are 
holomorphic at s = maxpi(x)- 

The author carried out this program for Sym^A;" and Sym^A;^ (/) k'^ ■ We describe 
our results in §8. Consider the second case. The stratum Sfs^ in §2 corresponds 
to the representation (2) in §2. The zeta function for this case was handled by F. 
Sato (see [14]) in a slightly different formulation. The author handled two more 
reducible prehomogeneous vector spaces which correspond to fi&^fi^ in §2 from our 
viewpoint. These are reducible representations with two irreducible components. 
The reader should see [26] for the details of these cases. In the future, we have to 
generalize the method so that we can handle representations with more than two 
irreducible factors. 

For the rest of this section, we briefly discuss how we proceed, and point out 
technical difficulties. We consider an irreducible prehomogeneous vector space of 
complete type {G^V^xv) for simplicity. So G\ = G^, and we do not have to 
consider x- 

By the Morse stratiflcation, 

j{^,g') = J2 {es.i^Ag'r) - 0s,($,^/^)) + $(0) - $(0). 

/9 
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Therefore, 

u{g')Ji<^,g')^ig\w,tP)dg' 

= J2f uig')Qs,i^,ig'yMg\^,i^)dg' 

-Y^\ u{g^)Qs,{^.g'W{g\w,Tp)dg^ 
+ ^^($(0) - $(0)). 

w — Wo 

In this way, we can at least start considering the contributions from unstable strata 
indirectly by the use of the smoothed Eisenstein series. Let 

S^($,cu,u;)= / uj{g^)Qsp{<^,g^W{g\w,tP)dg\ 

■JGl/Gk 

First, it can happen that cu, t/;) ~ for some strata /3. For Sym^A;^ (x) A;^, 

this is the case for fi = /32,/33,/35- Therefore, not all the strata contribute to the 
poles, and these strata have to be removed. 

If $ = My,^$, 

= / cu(fi'J)0YBB($,gfJn;9(M;9))<f(fi'Jn;9(M;9),u;, V')(fi'J)"^''''(/fi'Jc/M;9, 

JPUIPpk 

where Pj^ = P^ja H PjS is half the sum of positive weights of PjS, and dg^^, dujs 
are invariant measures on M^a H G\,Uj3A- We want to compare this integral 
with the integration on M^a H G\/Mj3k by considering the constant terms of both 
0Y^33($, (/^n^(M^)), and ^(g^^nj3(uj3),w,tp) with respect to UjS. Then the result- 
ing integral resembles the zeta function for {Mf),Zf)) except it still has the Eisen- 
stein series in the integrand. However, the estimate of the non-constant terms is 
a formidable task. In the case Sym (i) k'^ , this was done by considering further 
stratifications of the representations Zf^ using the notion of /3-sequences ([10, pp. 
73]). 

Also it is too optimistic to expect that for all /3, 

io{g')es,i^,g'Mg\w,^P)dg' ~ Jl^a^($,^) 
GjJGk W-Wo 

for some a^($,c<;), satisfying a similar property as in (7.2) (2). This is because there 
are interactions (both constant terms and non-constant terms) between strata. For 
example, for Sym^A;^ (/) A;^, some cancellations have to be established between the 
strata S'/jg, Sfs^^ Sfs^. Those cancellations can be established only if we consider the 
further Morse stratifications of the representations Zf^^ etc. The reader should see 
[26] for the details. 
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§8 Examples of principal part formulas 

In this section, we consider some examples of prehomogeneous vector spaces for 
which the principal parts of the poles of the zeta function were determined. In 
order to state them, we have to introduce some notation. 

Let $ G ^(Va), and Sp = G Xp^^ be a stratum. We define Rpf^ G ^(Z^ja) 
by the formula 

Rp^x) = / Hx,y)dy 

for X G ^/?A, where dy is the measure on VF^a such that /v^^^/vK^^ dy = 1. 

Let \E' G ,5^{K^ ). Let cui , • • • , cu^ be characters of / A; ^ , and u = {ui , • • • , cu^). 
For t = (ti, • • • ^ti) ^ A\ we define io(t) = Ylj LOj{tj). We consider as a character 
of {k'' Ik'^y. Let 0^(*,t) = Exe(fcx)i For s = (^i,--- ,5,) G C, and t as 

above, we define in an obvious manner. 

Definition (8.1) 

E,(^,cu,3)= / \t\'u{t)Q,{<^,t)d.''t. 

J (AX ik'xy 



If Lo is trivial, we drop cu, and use the notation Si(\E', s). 

Definition (8.2) For j = (j'l,--- G Z*, sq = (■5o,ir'' 5'5o,i) £ C*, we ■u^e 
i/ie notation Yli (^j^ ... j.~^{^,LO,SQ)for the coefficient of Y\^{si — sq^iY' in the Laurent 
expansion of Ei(\E', cu, s) at s = sq. We also drop u in this notation when u is 
trivial. 

If Si(\E', cu, s) is holomorphic at s = sq, (q,-- - ,o)(^7 ^7 ■^o) = Si(\E', cu, sq)- 

(1) The case G = GL(1) X GL(2), V = Sym^P 

We consider the situation in the second example in §2. We define the zeta 
function by (4.4) (see the remark after (4.4)) for L = V^^ . The following theorem 
was proved by Shintani [18], and the adelic version can be found in [22]. 

Theorem (8.3) Suppose that $ = Mv,lo^- Then 

'$(0) $(0)A 



Zy($,cu,5) = Zy+($,cu,5) + Zy+($,cu-\4-5) + 532%(cu) 



s -4 

Ei(i?^J,-l) Ei(i?^,$,-1)A 



s - 4 



Si(i?^,$,cu-M) Si(i?^,$,cui,f) 
3s - 10 3s - 2 



(2) The case G = GL(1) x GL(2), V = Sym^A;^ 

In this case, there is precisely one unstable stratum Sfs^ , where /3i = 2 using 
a similar identification IR = t as in §2 (1). The following theorem was proved by 
Shintani [19], and the adelic version can be found in [25]. 
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Theorem (8.4) Suppose that $ = Mv,lv^. Then 
Zy,ad($,cu,5) = Zv+i<^,oJ,s) + Zy+($,cu-\3 - s) 

- ^Tv+{Rv,o^,io,s) - ^Tv+{Rv,o^,io-\3-s) 
2 y (5-2)2 + 

%2)%2) /^Si,(_i)(i?^,$,CUi,l) ^ Ei,(o)(i?^,$,CUi,l) 



(3) The case G = GL(1) x GL(n), 1/ = Sym^A;'^ ^ 

The case n = 2 is the previous case. Let T be as before, and we consider 
(G/T, y). If n > 3, it is of complete type and X*(G/T) is generated by one 
element. So we consider the situation in (4.4). We define 

^^n,(j)(^'^''^o)' ^l^2,ad,(j)(^'^''5o) 

similarly as in (8.2). 

Let Sfs- be the set of rank n — i forms. Then Sfs^^ • • • , Sfs^_^ are unstable strata. 
For all z, Yf^. = Zf^. = Vn-i- Let 20*^ t>e the set of points of the form 

{(0,a;i,0)} by the above identification. For $ G .5^(Va) and xi G ^5 let 



^)?„_2,o^(^i) = / i?/?„_2$(0,a;i,a;2)(^a^2. 



Shintani proved a partial result, and the author carried out the complete calcu- 
lation of the principal parts in this case (see [19], [25]). 
If n = 3, we define 

F3($,CU,S) = 5J3(*)#(CU) V^20{iO2)- 



+ 6{i02) 



s - V 2s - 3 

^y2,ad,(0)(^/9i^,(^l,l),3) 

s - 3 



'3Ei(i?;^^^ Ei,(i)(i?;,^^o$,2) 
+ '^#(^) — ^ + 



2(5 - 3)2 2(5 - 3) 

If n > 4, we define 

Fn(^,iO,s) =^nO#(iO) h > (n - t)^^d((jJ2) ^ 

s ^ — ^ Zs — n(n — i) 

i^l,n-2 ^ ' 

, ^ ct ^ ^l^2,ad(i^;9„_2^,(^l,l),?^) 

s — n 

+ - '^^^"^^ 23-n(n-l) 

/^Si(i?;,_^^o$,n-l) Ei,(i)(i?;,_^^o$,n-l)\ 



+ 5J„-2%(cu) -i^T^^^^^^i + 



2(s-n)2 2(s-n) 
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Theorem (8.5) Let n > 3. Suppose that Mv„,io^ = Then 



- ^^^^ - 3) - 

Suppose that $ = (x)j,$j,, and has a compact support contained in V^^ for a 

place u G OJtoo- Then it turns out that El (i?^ _^ 0$, n — 1) = Ei (i?^ _^Q$,n — 1) = 
0. Therefore, the poles of the associated Dirichlet series are all simple. 

(4) The case G = GL(3) x GL(2), V = Sym^k^ (g) 

This is the third example in §2. Let u = {loi,lo2) be as before. In order to handle 
the zeta function in this case, we need to know the pole structures of zeta func- 
tions for unstable strata. The strata S f)^, S f)^, S f)^ do not contribute to the poles. 
The stratum Sf)^ corresponds to V3 in (3). Let E^^(\I/,c<;', s) = Zy^{^ ,lo' , s) for 
^ G J?^(Z^ia), ^' a character of Ik"" X GL(3)V GL(2);t, and s G C. The distri- 
bution E^^(\I/,c<;', s) is holomorphic at s = 2. The stratum Sf)^ corresponds to the 
prehomogeneous vector space GL(2) X GL(2)/T, V = k'^ (i) k'^ , where T is as before. 
We define cu', s) by (4.4). The distribution E^4(\I/, cu', s) is holomorphic at 

s = —2. The strata S'/jg, Sj3g correspond to GL(2) X GL(1)^/T, V = Sym^A;^ ® A; or 
Sym^ A;^® A;^ where GL(2) acts on k trivially, and the action of GL(1)^ is similar as in 
§2. A similar argument as in §2 holds for Sfs^ also. We choose (&i,&2) = (3, 5), (3, 4) 
for S^^,S^^ respectively. Let aj^{Xi) = {I, Xl, Xi^), a^^{Xi) = (l,Ai,Ar^) 
Ai G Then we can choose T = {a^g(Ai) | Ai G ^+} or {a^g(Ai) | Ai G ^+}- 

We use c/^Ai on T. Let XiSe^XiSs t>e principal quasi-characters of G\/Gk satisfy- 
ing Xfieici'fiei^i)) = ^]"\ XfisiafiJXi)) = Xj. We define E;9^(^', cu', X/?8 , ■s) by (4.4). 
This case was handled by F. Sato in a slightly different formulation [14]. Note 
that io' = (cui,^,cu^) is a character on GL(2)V GL(2);t X (A^/A;^)^. The case 
Sym^A;^®A;is of incomplete type, and let E^g^ad(^, X/?6 5 t»e the adjusted zeta 
function (see [26] for the details). The distribution E^g(\I/, cu', x^g , s) is holomor- 
phic at s = —3, but E^g(\I/, cu', x^g, s) has a possible simple pole at s = —3. We 
choose (xi, 33, a;2, 13, 2:2,22) (resp. (xi, 23, 2:2,13, 2:2,22)) as the coordinate of Z^j^ (resp. 
Zfi^). The stratum Sfj^, corresponds to GL(2) X GL(2)/f, T = Sym^A;^ k^ . We 
define E^^q(\I/, cu', s) by (4.4). This case is of incomplete type, and requires an ad- 
justing term. Let E^^Q^ad(^, ■s) be the adjusted zeta function. The distribution 
S/?io,ad(^, ■s) is holomorphic at s = 3. Let Z'^^ q (resp. Z'^^^ q) be the set of 
points x's such that Xijk = except for 2:1^33 , 2:2,12 (resp. 2:1^33 , 2:2, 22)- We define 

^/?6, 0^(^1,33, 2:2,12) 

^)?io,0^(^l,33, 2:2,22) 

We need some definitions in order to state the result in this case. 
Definition (8.6) 



-2,22, 



/ i?/?g$(2:i,33, 0,2:2,12, 2:2, 22)<i2:5 
J A 

i?/9,o$(0, 0, 2:1,33, 2:2,22, 2:2,23, 2:2, 33)<i2:2, 23(^2:2, 33- 



A2 
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(1) S^^{UJ) = S{UJ2), iO^^ = 

(2) ^pS'^) = S((jJi), LOp^ = (1,CU2), 

(3) Sfijio) = 6((jjI), LOp^ = (CU1,CU2,CU2), 

(4) Sfi^iio) = 6((jjI)6((jjI), LOp^ = (CU2,CU1,CU;^^CU2), 

(5) Sfijio) = 6((jJi), LOp^ = (CU1,CU2,CU2), 

(6) S^^{uj) = S{ujf)S{uj2), uj^, = 

(7) Sfi^Jio) = 6(iOi),6fi^^^,t(io) = 6(iOi)6(iol), top^^ = (1, 1^2), cu^^o,** = (^2,^2)- 
We define 

+ 8(5^6(cu)E^g,ad(i?;96$,^;96,X;96, 

+ l%8(^)S;98,(0)(^,98^,^,98,X;98,-3)) 

+ {5^2,(l,0)(R'^e,0^^ -1' -3) + 3S2,(o,l)(i?;3e,0$, "1, "3)) 

F_2($,cu, 0) = - 3%(cu)E2(i?;3,,o$, -1, -3), 

F_i($,CU,3) = ^^E3,(o,0,0)(i?;9r$,^;9r,^,0,^) 
+ '^/?io(^)S/9io,ad(i?/?io^,^/?io5 3) 

^ ^2,(l,0)l-K/?io,0^5^/9io,**5 2' 2'' 

1^ ^2,(0,l)l-K/?io,0^5^/9io,**5 2' 2'*' 



j = 0,3,j = l,2 ^ ^ 

We proved the following theorem in [26]. 
Theorem (8.7) Suppose that Mv,u;^ = Then 

Most of the coefficients of the Laurent expansions at the poles of Z($,c<;,s) are 
generalized special values of the adjusted zeta functions defined for Z^'s. However, 
we have some extra terms like E2^(i^o)(-R)9g o^' ~3). The author expects similar 
phenomena for other prehomogeneous vector spaces. Also the author hopes to 
handle more cases in the near future. 
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